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Abstract 

An abstract architecture for idealized multi-agent systems whose be- 
haviour is regulated by normative systems is developed and discussed. 
Agent choices are determined partially by the preference ordering of pos- 
sible states and partially by normative considerations: The agent chooses 
that act which leads to the best outcome of all permissible actions. If an 
action is non-permissible depends on if the result of performing that ac- 
tion leads to a state satisfying a condition which is forbidden, according to 
the norms regulating the multi-agent system. This idea is formalized by 
defining set-theoretic predicates characterizing multi-agent systems. The 
definition of the predicate uses decision theory, the Kanger-Lindahl the- 
ory of normative positions, and an algebraic representation of normative 
systems. 

Keywords: Norm, Multi-agent system, Norm-regulated system, Agent 
architecture, Boolean algebra, Normative position 

1 Introduction 

Within economic theory the consumer's behaviour has traditionally been 
described as determined by a utility function. During the latest two 
decades there has been a growing interest among researchers in how norms 
(for example rules of law) give restrictions on the behaviour induced by 
the utility function. The behaviour of the consumers or other economic 
agents, according to this model, is the result of an interplay between op- 
timization of the utility function and restrictions due to norms. We will 
here show how this model can be used for regulating the behaviour of 
artificial agents. 
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An important problem in the behavioral sciences is how the auton- 
omy of the individual can be reconciled with collective rationality, i.e. the 
rationality of the group? 1 If the individual is a human agent and the 
collective in question is the state, we are approaching a profound problem 
for politics and social science. However, here we limit ourselves to some 
aspects of a more modest question: What is an appropriate formal frame- 
work for the unification of individual autonomy with collective rationality 
for artificial agent systems? To our technical problem, the solution could 
be an agent architecture with a large range of applications. But this tech- 
nical problem also has some bearing on the more general one mentioned 
above, as it may make it possible to construct and test model systems 
which resemble human social systems in some basic sense. 

The approach to unification of individual autonomy and collective ra- 
tionality chosen here is, as has already been emphasized, to focus on 
norms. There are mainly two aspects of norms in relation to multi-agent 
systems that will be dealt with, viz. 

(1) the formal representation of norms regulating multi-agent systems 

and 

(2) the role of norms in architectures for multi-agent systems. 
These two aspects of multi-agent systems (Mas) are not independent, 

on the contrary: they presuppose each other. The aim of the essay as far 
as norm representation is concerned is to test an algebraic representation 
of normative systems |19| |2(J| [11] [11] [lb] utilizing the Kanger-Lindahl 
theory of normative positions |14| |17| |18|. and its later developments. 
In this essay we will discuss some characteristic features of this kind of 
norm representation and investigate the possibility of using it in Mas ar- 
chitectures. We have strived for imposing no particular choice of Mas 
architecture; a related study for a Belief-Desire-Intention agent architec- 
ture, for instance, is HJ. 

Next a few words about (2). The role that norms will have in Mas 
architectures is to delimit the autonomy of the agents. Metaphorically one 
can say that the norms define the scope (Spielraum) for an agent. The 
'wish' or 'desire' of an agent is represented as a preference structure over 
possible states or situations. 2 From the norms of the system will follow 
a deontic structure of the states (consisting for example of normative 
positions) implying that some states are permissible while the rest are non- 
permissible. The agent chooses an act which leads to the permissible state 
it prefers the most. In section 3, we will transform this idea to a theory or 
model of how norms can be used to regulate the behaviour of multi-agent 
systems. The model will use the kind of norm representation mentioned 
above and it will be expressed in terms of set-theoretical predicates. Since 
this is the first attempt to test the above described approach we will use 
a rather idealized kind of Mas. The extent and goal of the idealization 
will be discussed at the beginning of section 3. 

The study of how the behaviour of agents can be regulated by norms 

1 Related to this problem is the question whether the autonomy of one individual restricts 
the autonomy of other individuals. 

2 A preference structure consists of a preference relation and perhaps one or several other 
relations, for example a difference relation. 
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has been pursued within many fields, including biology, computer science, 
economics, law, sociology and philosophy. Formalisms have often been 
employed in cross-disciplinary fashion, as in the combination of mathe- 
matics and logic |24| . speech act theory and computational linguistics 8 , 
and computer science and anticipatory systems 0j. What constitutes a 
norm naturally differs between such approaches. In this essay, a norm is 
represented as an implicative sentence where the antecedent is a descrip- 
tive condition stating the circumstances of an agent, and the consequent is 
a condition expressing the normative position that the agent has with re- 
spect to a state of affairs. A normative system is a joining of two Boolean 
algebra based on such implications. Our approach to norms is within the 
tradition of algebraic logic. 

It is possible to regard the expression 'norms for artificial agents' as 
metaphorical, but we do not. From a formal point of view, multi-agent 
systems are sufficiently similar independently of whether the agents are 
human or not. In this essay, we adopt a fairly formal notion of a norm: 
a norm is characterized by its form or structure and not, for example, by 
its function. 

In section 2, norms and normative systems are examined from differ- 
ent perspectives. The Kanger-Lindahl theory of normative positions is 
presented, and the representation problem of normative systems is intro- 
duced and an algebraic approach to its solution is outlined. In section 3, 
an abstract architecture for Mas based on deontic-action-logic is intro- 
duced. The formal structure of norms regulating the behaviour of such 
systems is presented in section 4. In sections 2-4, some of the ideas are 
elucidated using the waste collectors example. In section 5, an important 
step in the theory construction is presented, namely a scheme for how 
normative positions will restrict the set of acts that the agents are per- 
mitted to choose from. Section 6 contains conclusions and a discussion of 
possible extensions of the study. 

2 Representations of Norms 
2.1 The Waste Collectors Example 

We illustrate some of the ideas in this essay using an example, introduced 
in [3], of a team of robots collecting nuclear waste. Each robot is here 
represented as one agent, and is placed on a spatial grid. It is important 
to realize that this example is here exploited for elucidating the role of 
norms in regulating the behavior of an agent system. It is not what the 
norms say, the material content of the norms, that is of interest here but 
their logical form and their formal connection to other parts of the agent 
architecture. Thus it is not the reasonableness of the normative systems 
which interest us but the reasonableness of the form of their representation 
and their role in the architecture. 

Think of a spatial grid of squares in rows and columns. Each square is 
assigned a coordinate consisting of an ordered pair of integers, where the 
first number in the pair represents the column and the second the row. 
On some squares there is a number representing an amount of waste. A 
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group of agents, in the sequel called collectors, tries to collect as much 
waste as possible. Each collector has a utility function, such that the 
utility depends on the amount of waste per unit time (or unit distance). 

The agents can move one square at a time in four directions, up 
(north), down (south), left (west) and right (east); these are the possible 
actions of the agents. But there are restrictions on how they may move. 
It is especially important how an agent may move in the neighbourhood of 
another. The protected sphere around the agent lo consists of nine squares 
forming a large square with ui in the middle, i.e. the protected sphere is 
the von Neumann neighbourhood of w. The protected spheres of uj\ and 
u)2 can overlap with 1, 2, 3, 4, 6 or 9 squares. 

We will now present a set of norms which regulates how the agents 
may move. Suppose loi is about to move. 

(m) If the protected spheres of u>\ and u>2 do not overlap then u)i may 
not move so that lui and L02 overlap with two or three squares. 

(712) If the protected spheres of lui and LU2 do not overlap then lu\ may 
move so that u)\ and 1U2 overlap with zero or one square. 3 

(713) If the protected spheres of lu\ and LU2 overlap with one or two 
squares, then lui may move so that the protected spheres of lui and LU2 
overlap with any number of squares (even zero). 

(714) lui may move so that the protected spheres of lui and u>2 overlap 
with six squares only if the protected spheres of lui and 012 overlap with 
at least four squares. 

(715) If the protected spheres of lu\ and u>2 overlap with four squares 
then lui shall move so that the protected spheres of lui and u>2 do not 
overlap with three squares. 

(uq) If the protected spheres of lui and L02 overlap with six squares, 
then lu\ must move so that the protected spheres of lu\ and u>2 overlap 
with at least four squares. 

(717) loi may never move so that the protected spheres of lu\ and L02 
overlap with nine squares. 

(ng) io\ may always move so that the protected spheres of ui\ and L02 
overlap with zero squares. 

This is a very primitive normative system, but it is not so easy to see 
what it says. To grasp the content of the normative system a transparent 
way of structuring and representing the norms is necessary. It is easy 
to see that most of the norms, but not all of them, are implications, i.e. 
of the form p implies q. However, as we will see in a later section, all 
of them can easily be transformed to implications. Note also that the 
norms contain expressions like may, may not and shall. To simplify, let 
us introduce some predicates. The protected sphere around lu is denoted 
Protec(u). Lapi(u>\ , L02) means that the protected spheres around lui and 
u)2 overlap with i squares. As a first step in the formalization of norms 
(ni) and (712) we can write them as follows: 

(m) If Lapo(u>i,uj2) then it may not be the case that lu\ sees to it that 
Lap2(uJi,uJ2) or Lap;i(cji, LU2). 

3 Note that if the protected spheres of lui and u>2 do not overlap then u>i cannot move so 
that the spheres of loi and 102 overlap with more than three squares. 
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(ri'2) If Lap (iOi,uj2) then it may be the case that u)\ sees to it that 
Lapo(uJi,L02) and Lopi(o>i, 0)2)- 

The expression 1 lu\ sees to it that' states the fact that ui is active and 
moves and thereby sees to it that the overlap in question is realized. Let us 
use Do(oji,_F) as an abbreviation for l tvi sees to it that F\ Furthermore, 
let us use 'May' as an abbreviation for 'it may be the case that' and 'Shall' 
for 'it shall be the case that. We can then represent norms (m) and (712) 
as follows. 

(m) Lapo(uji,L02) — > ^May Do(ti)i, Lap2 (1^1,^2) V Lap3(a>i, ^2)) 

(112) Lap (i0i,uj2) — > May Do(cji, Lapo(iOi, tJ2))AMay Dofwi, Lapi(iOi, UJ2)) 

The other norms can be represented in a similar way. 

(713) For alii, < i < 9, Lapi(toi, U2)\lLap2 (wi, ^2) — > May Do(ui, Lapi(u>i, 012)) 

(714) —iLapi(u}\, LJ2)/\~ l Lape(bJi, uJ2)/\~'Lapg{u)\, UJ2) — > ^May Do(o»i, Lap(,(u>\,u>2)) 

(715) Lap4,{u)\,uJ2) — > Shall T>o(lo\,—< Lapz(ijii,uJ2)) 

(n6) Lape(ui,u>2) — > Shall Do(o;i,Lap4(a;i,W2)VLop6(wi,a;2)VLop9(a;i,a;2)) 
(717) wi 7^ u)2 — > ^May Do(ui, Lop9(wi, W2)) 
(n 8 ) May Do(wi, Lap (wi, W2)) 

In the formulations of (m) — (ns) we have as a simplification omitted 
the universal quantifiers. For example (m) ought to be written more 
completely as 

(n'i) Vcj2 : [Lapo(coi,L02) — > -May Do(wi, Lop2(wi, UI2) V Lop3(o»i, UI2))] 
This is just the first step in the representation of norms using de- 
ontic and action logic. In the next section we will discuss this kind of 
representation in some detail and show how we can get a more effective 
representation. We will return to the waste collectors in sections 3 and 4. 

Note that a typical norm asserts that if a condition on the position of 
uji is fulfilled, then ui\ may or may not see to it that another condition will 
or will not be the case. An idea elaborated on in section 5 is that it is not 
permissible for loi to perform an act which leads to a situation such that 
a condition c will be fulfilled, if c is such that u>i may not see to it that c 
is fulfilled. In this way the norms formulated in terms of requirements on 
positions determine what is permissible or obligatory for the agent to do 
in a given situation. 

2.2 Norms as Ordered Pairs 

A typical norm is a universal implication and in predicate logic it can 
often be represented as a universal sentence of the following form: 
(n 9 ) : Vcci, ...,x v : p{x\, ...,x v ) — > q(x\, x u ). 

Syntactically it consists of three parts: the sequence of universal quan- 
tifiers, the antecedent formula and the consequent formula. Note that 
norm (719) correlates open sentences: p(xi, x v ) is correlated to q(x\, x v ). 
An alternative point of view is to regard p and q as conditions and a norm 
as a relational statement correlating them: 
(nio) : pHq 

It is important here that the free variables in p(xi, x v ) are the same 
and in the same order as the free variables in q{xi, x v ). (It is, however, 
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not necessary that p and g have the same arity, for details see |2U|.') 1Z is a 
binary relation, and plZq is a relational statement equivalent to (p, g) £ 1Z. 
Thus, we can represent a norm as plZq or (p, q) G 7?,, and from the latter 
relational statement it is just a small step to the representation of (nio) as 
the ordered pair {p, q) where p is called the ground and q the consequence 
of the norm. A ground is a descriptive and a consequence is a normative 
condition. 

As is easy to see, we can form conjunctions, disjunctions and negations 
of conditions in the following way. 

(p A q)(u>i, u„) if and only if p(u*>i, ...,u>„) and q(uJi y u„). 
(p V q)(u)i, u„) if and only if p(uj ly ...,ui u ) or g(o>i, 
(p')(loi, u„) if and only if -ip(ui, 

It is therefore possible to construct Boolean algebras of conditions and 
we will return to this in subsection 2.4. 

If p is a v-axy condition and ii, ...,£„ are individuals, then p(ii, i v ) is 
a sentence. A norm {p, q) can be regarded as a mechanism of inference. We 
can distinguish two cases. Suppose that p and s are descriptive conditions 
and q and t are normative. 

1. From p(ii, i„) together with (p,q) follows q(i\, ...,i v ), 

2. From slip together with (p, q) and qTZt follows sIZt. 4 

In 1, (p,q) functions as a deductive mechanism correlating sentences 
by means of instantiation, while in 2, (p, g) correlates one condition to an- 
other condition. Therefore, in the terminology of pQ|, 1 corresponds to the 
correlation of individual cases to individual solutions, and 2 corresponds 
to the correlation of generic cases to generic solutions. 

Let us return to the suggested norm (rii) in the waste collector example 
above. The ground of the norm is the binary condition Lapo and the 
consequence is the condition A defined in the following way: 

K(ui,lj2) iff ^May Do(wi, Lap2(u> 1 , C02) V Laps{ui, 1^2)). 
A is a normative condition obtained by applying the operators May 
and Do to the disjunction of the descriptive conditions Lap2 and Laps. 

2.3 Normative Positions 

An important contribution to deontic logic was made by Stig Kanger, 
who combined the deontic operator Shall with the binary action operator 
Do |13| . To be specific, Shall Do(i, g) means that it shall be that x sees to 
it that g, while -iShall Do(i/, ^g) means that it is not the case that it shall 
be that y sees to it that not g. The combination of the deontic operator 
Shall with the action operator Do and the negation operation -1 gives us 
a powerful language for expressing purely normative sentences. Kanger 
emphasized the possibilities of external and internal negation of sentences 
where these operators are combined. Using combinations of deontic and 

4 Note that sIZp is relating two sentences of the same kind and the same holds for qTZt; 
s and p are descriptive but q and t are normative. A norm consists of sentences of different 
kinds. 
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action operators, we can formulate norms in a concise way. A conditional 
norm may for example have the form: 

p(x,y) -» Shall Do(a;,-.g(y)). 

Note that the sentence May Do(x,q) can be defined in terms of the 
operators Shall and Do in the following way: 

May Do(x, q) if and only if -nShall -iT>o{x, q). 

The logical postulates for Shall and Do assumed by Kanger are (where 
is the relation of logical consequence and of logical equivalence) : 

1. If p =>- q, then Shall p => Shall q. 

2. (Shall p & Shall q) =^> Shall(p & q). 

3. Shall p -.Shall -, p. 

4. If p •<=> g, then Do(a;,p) •<=>■ Do(:r, g). 

5. Do(a;,p) => p. 

The five conditions are, according to Kanger, acceptable in most con- 
texts. 

Kanger used the deontic-action-language as a basis for a theory of 
normative positions and his theory, expressed as a theory of types of 
rights, was further developed by Lars Lindahl in his three systems of 
types of normative positions |17l . The simplest one is the system of one- 
agent types of normative position, and we will restrict ourselves to the 
utilization of this system here. 

Let ±o stand for either of a or ->a. Starting from the scheme ±May±Do(a;, ±g), 
where ± stands for the two alternatives of affirmation or negation, a list is 
made of all maximal and consistent conjunctions — maxiconjunctions (see 
22 p.405f.) — such that each conjunct satisfies the scheme. Note that the 
expression -nDo(:r,g)& -iDo(a;, -ig) expresses x's passivity with regard to q. 
Here this expression is abbreviated as Pass(:r,g). By this procedure the 
following list of seven maxiconjunctions is obtained, which are denoted 
T 1 (x,q),...,T 7 (x,q) (see \T7\, p.92). 



T2(x,q) 
T 3 (x,g) 
Ti(x,q) 

T B (x,q) 
Te(x,q) 
T 7 (x,q) 



MayDo(:r, q) & MayPass(:r, q) & MayDo(x, -ig). 
MayDo(:r, q) & MayPass(:r, q) & -.MayDo(a;, ^g). 
MayDo(:r, q) & ^MayPass(a;, q) & MayDo(:r, ^g). 

-iMayDo(a:, q) & MayPass(a;, q) & MayDo(a;, ^g). 
MayDo(:r, q) & ^MayPass(a;, q) & -.MayDo(x, ^g). 

-iMayDo(a;, g) & MayPass(a;, g) & -.MayDo(:r, ->g). 

-.MayDo(a;, g) & -.MayPass(x, g) & MayDo(:r, -ig). 



Ti,...,T7 are called the types of one-agent positions. Note that 
^MayDo (x,q) & -i MayPass (x,q) & -nMayDo(i, -ig) is logically false, 
according to the logic of Shall and May. It is easy to see that the last 
three types can more concisely be described as follows: 

• T 5 (x,g) : Shall Do(x,g). 

• Te(x,g) : Shall Pass(x,g). 
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• T 7 (x,q) : Shall Do(x,^g). 

Note that the following symmetry principles hold: 

• Ti(a;, q) if and only if Ti(x, ->q) 

• T2(x, q) if and only if T4(x, ->q) 

• Ts(x, q) if and only if T3(s, ->q) 

• Ts(x, q) if and only if Tt(x, ->q) 

• Tq(x, q) if and only if Te(a;, ->q) 

The systems of normative positions can serve as a tool for describing 
the normative positions of different agents x,y,z... with regard to states 
of affairs p, q,r, .... A set of such descriptions, however, is not a represen- 
tation of a normative system. This is due to the fact that a normative 
system is not a description of the actual normative positions of individuals. 
Rather, the essential feature of a normative system consists in so-called 
normative correlations, i.e., as jurists might say, in correlating norma- 
tive consequences to operative facts. The formal system of normative 
positions increases the expressive power of norm formulation as regards 
consequences. 

The one-agent types in the Kanger-Lindahl theory of normative po- 
sitions can be used as operators on descriptive conditions to get deontic 
conditions 21 . As a simple example, suppose that r is a unary con- 
dition. Then Tir (with 1 < i < 7) is the binary condition such that 
Tir(y,x) iff Ti(x,r(y)), where r Ti(x,r(y)) is the ith formula of one-agent 
normative positions. Note that for example r Tg(x,r(y)) means 

MayDo(:r, r(y)) & ^MayPass(a;, r(y)) & MayDo(a;, ->r(y)). 

If (p, Tir) is a norm, then from p(xi, X2) we can, by using the norm, in- 
fer Tir[xi,X2) and thus also Ti(x%, r{xij), which means that, with regard 
to the state of affairs r(xi), X2 has a normative position of type Tj. 

The theory of normative positions was developed during the 60s and 
70s, primarily as an analytical tool to be used in jurisprudence and politi- 
cal science; Kanger's theory was originally expressed as a theory of types of 
rights. Some further refinement of the systems have more recently been 
made by Andrew J.I. Jones and Marek Sergot (see [H] EH H3 WD- 
A special feature of the work of Jones and Sergot, as of Herrestad and 
Krogh |15| |16|. is that applications in computer science are in view. Even 
though Sergot has constructed a computer program, Norman-G, based on 
the theory of normative positions, we have chosen to base our exposition 
on Kanger/Lindahl in order to not complicate the model further. 

2.4 Representations of Norms: The Algebraic Ap- 
proach 

An adequate representation of norms is important for the construction of 
norm-based architectures and we will here use an algebraic approach to 
the representation problem. 5 One of the main tools in this endeavour is 

5 This subsection is based on earlier work by Lindahl and Odelstad, see 1211 1241 1251 . 
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the theory of a Boolean quasi-ordering, which is an extension of the theory 
of Boolean algebras. A norm is regarded as consisting of two objects, a 
ground and a consequence standing in a relation to each other. The ground 
belongs to one Boolean quasi-ordering and the consequence to another. 
Therefore, we can view a normative system as a joining of a Boolean 
quasi-ordering of grounds to a Boolean quasi-ordering of consequences. 
Definition. The relational structure (B, A,' , R) is a Boolean quasi- ordering 
(Bqo) if (B, A,' } is Boolean algebra and R is a binary, reflexive and tran- 
sitive relation on B (i.e. R is a quasi-ordering) such that R satisfies the 
following conditions for all a, b and c in B: 

(1) aRb and aRc implies aR(b A c). 

(2) aRb implies b'Ra'. 

(3) (a A b)Ra. 

(4) not Ti?_L. ■ 

Before we describe the use of Boolean quasi-orderings for representing 
norms, let us say a few words on some formal aspects of such structures. 
The indifference part of R is denoted Q and is defined by: aQb if and only 
if aRb and bRa. Similarly, the strict part of R is denoted S and is defined 
by: aSb if and only if aRb and not bRa. 

Let < be the partial ordering determined by the Boolean algebra 
(B, A,' }. 6 From requirement (3) for Boolean quasi-orderings it follows that 
a < b implies aRb. If (B, A,' , R) is a Boolean quasi-ordering then we say 
that the Boolean algebra {B, A,' ) is the reduct of (B,A,' ,R), denoted 

Suppose that B = {B, A,' ,R) is a Boolean quasi-ordering and Q is 
the indifference part of R. The quotient algebra of B with respect to 
Q is a structure {B/Q, n, — , <q) such that {B/Q, n, — ) is a Boolean al- 
gebra and is the partial ordering determined by this algebra. The 
natural mapping of {B, A,' ) onto (B/Q, PI, — ) is a homomorphism |24|. 
and (B/Q, n, — ) is called the quotient reduction of £?. Thus there are two 
Boolean algebras which should be kept apart, namely B red , i.e. the reduct 
of B, and the quotient reduction of B. 

Although, by a transition to equivalence classes, from a Boolean quasi- 
ordering we get a new Boolean algebra, there is a point in remaining 
within the framework of Boolean quasi-orderings. In the models where 
the domain of a Boolean quasi-ordering is a set of conditions, we may 
want to distinguish two conditions a and b even though it holds that aQb 
(and therefore a and b belong to the same Q-equivalence class), because 
they may have different meaning. 

An important class of models of the theory of Boolean quasi-orderings 
consists of models having a set of conditions as its domain. 
Definition. A condition implication structure (cis) is a Boolean quasi- 
ordering B — (B, A,' , R) such that B is a domain of conditions, and R is 
such that aRb represents that a implies b. ■ 

This reading of R is justified since, if a and b are v— ary conditions, 
aRb is the representation of 

Vxi, ..,Xu '■ a(xi, ...,x v ) — > b(x\, ...,x v ). 
As per usual, < is defined by a < b if and only if a A b = a. 
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The theory of Boolean quasi-orderings is of a very general character, 
and condition implication structures are not the only kind of models which 
are interesting as representations of normative structures. It is easy to see 
that we can construct a model of this theory out of a first order theory 
E. Consider the structure {B, A,' , R) where (B, A,') is the Lindenbaum 
algebra of the predicate calculus. Let R be the quasi-ordering on B de- 
termined by the Lindenbaum algebra of E. Then (B, A,' , R) is a Boolean 
quasi-ordering (cf. p. 61 and Q, p. 73). 

From an algebraic point of view a norm is a kind of link or joining of 
one Boolean quasi-ordering to another. To make this idea precise we need 
some definitions. 

Definition. The subinterval relation generated by the quasi-orderings 
(Bi,Ri) and (^2,^2) is the binary relation < on B\ x B2 such that 
(01,02) < (61,62) if and only if biRai and 02-R62. ■ 

Note that < is a quasi-ordering, i.e. transitive and reflexive. Let 
=c= denote the equality part of < and < the strict part of <. Then the 
following holds: 

(01,(12) o (61,62) if and only if b\Q\a\ and 02(3262 
(01,02) < (61,62) if and only if (piSiai and 02-R262) or (6ii?iai and 
02S262) 

where Qi is the equality-part of Ri and Si is the strict part of Ri. (01,02) 
is a minimal element in X C B1XB2 with respect to (Si, Ri) and {B2, R2) 
if and only if there is no (£1,0:2) 6 X such that (£1,2:2) < (01,02). 

A quasi-ordering is closely related to a partial ordering. If {B,R} is 
a quasi-ordering and Q is the equivalence part of R, then R generates 
a partial ordering on the set of Q-equivalence classes generated from B. 
The definitions of least upper bound (lub) and greatest lower bound (gib) 
for partial orderings are easily extended to quasi-orderings, but the lub 
or gib of a subset of a quasi-ordering is not necessarily unique but can 
consist of a set of elements. 

Definition. A joining-system is an ordered triple (Bi , B2, J) such that 
£>i = (Si, R\) and B2 = {B2, R2) are quasi-orderings and J C B1XB2 and 
the following conditions are satisfied where < is the subinterval relation 
generated by Bi and B2: 

(1) for all 61, ci G Bi and 62,02 G B2, (61,62) G J and (61,62) < (ci,C2) 
implies (ci, C2) G J, 

(2) if for all ci G Ci C Bj, (ci,6 2 ) G J and lub Ci ^ 0, then (01,62) G J 
for all ai G lub Ci, 

(3) if for all c 2 G C 2 C S 2 , (61, c 2 ) G J and p«6 C 2 / 0, then (61, o 2 ) G J 
for all a2 G gib C2. ■ 

Definition. Suppose that (B\,B2, J) is a joining system. A minimal 
element in {Bi, B2, J) is a minimal element (01,02) in J with respect 
to Bi and B2. The set of minimal elements in (£>i,£>2, J) is denoted 
min{B\,B2,J) or just minj '. ■ 

Definition. A Boolean joining-system (Bi, B2,J) is a joining-system 
such that B\ and 62 are Boolean quasi-orderings. A ground-consequence 
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system (gc-system) is a Boolean joining-system (Bi, B2, J) such that B\ 
and B2 are condition implication structures. ■ 

Definition. A Boolean joining-system (Bi,Bz, J) satisfies connectivity if 
whenever (01,02) 6 J there is (61,62) £ J such that (61,62) is a minimal 
element in (0i,B2, v 7) and (61,62) < (01,02) . ■ 

It is easy to see that if a Boolean joining-system satisfies connectivity, 
then the set of minimal joinings determines the set of joinings. If in a 
Boolean joining-system {Bi ,B2,J), Bi and Bi are complete in a sense 
which is a straightforward generalization of the notion of completeness 
applied to Boolean algebras, then (Si, B2, J) satisfies connectivity. For a 
proof, see |28) . 

A normative system M can be represented as a gc-system (£>i, B2, J) ■ 
The elements in J are then the norms of the system and in a norm 
(ai, 02) , ai is the ground and 02 the consequence. The elements in minj 
constitute the set of minimal norms of N '. If N satisfies connectivity, 
then it is characterized by its set of minimal norms, a fact which will be 
of interest in the sequel. 

The set of minimal elements of a joining system exhibits an interesting 
structure and it is possible to distinguish between different types of join- 
ing systems depending on the properties of the set of minimal elements 
(see 12' 1 1 and |21p. It is therefore also possible to distinguish between dif- 
ferent kinds of normative system depending on the structural properties 
of the set of minimal norms. Furthermore, applications of the set of min- 
imal norms seem to make changes and extensions of normative systems 
easy to describe and make it possible to divide the normative system into 
different parts which can be changed independently. However, these lines 
of thought will not be pursued here. 

3 An Architecture for Norm- Regulation 
of Multi- Agent Systems 

3.1 Deontic- Action-Logic Multi- Agent Systems 

In this section we will give a definition of a deontic-action-logic based 
multi-agent system, abbreviated Dalmas. Dalmas is an abstract archi- 
tecture (cf. |3UI . p. 31.) for idealized multi-agent systems using normative 
systems. The idea behind the architecture is roughly the following. When 
it is agent w's turn to move it chooses an act out of a set of feasible alterna- 
tives and the result will be that the system enters a new state; which state 
depends on the actual state of the system when the act is performed. The 
agent's choice is determined partially by the preference ordering of the 
possible states and partially by the deontic structure: the agent chooses 
that act which leads to the best outcome of all permissible actions. If an 
action is permissible or not depends on whether the result of performing 
the action leads to a state which satisfies a condition which is forbidden 
according to the normative system regulating the multi-agent system. In 
this section we shall see how this idea can be formalized. 
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Dalmas is a global clock (synchronous update), global state, global 
dynamics system. It can be viewed as a simplification constructed for 
conceptual and computer simulation purposes. In particular, we use the 
system as a model system for studying the interplay between preferences 
and norms in Mas architectures. We hope that it will be possible to 
transform the definition of a Dalmas into a system that allows for study 
through microsimulation (cf. 

Definition. A Dalmas is an ordered 7-tuple (SI, S, A, A, A, II, T) con- 
taining 

• an agent set Q {u,x, o>i, ... elements in Q), 

• a state or phase space S (r, s, si, ... elements in S), 

• an action set A such that for all a G A, a : fl x S — ► S such that 
a(aj, r) = s means that if the agent u) performs the act a in state r, 
then the result will be state s (a, 6, 01, ... elements in A), 7 

• a function A : £1 x S — ► p(A) where p(A) is the power set of A; 
A(u>, s) is the set of acts accessible (feasible) for agent ui in state s, 

• a deontic structure-operator A : x S — ► T> where T> is a set of 
deontic structures of the same type with subsets of A as domains 
and A(cj, s) is uj's deontic structure on A(u>, s) in state s, 8 

• a preference structure-operator II : Q, x S — > V where V is a set of 
preference structures of the same type with subsets of A as domains 
and II(aj, s) is ui 's preference structure on A{ui, s) in state s, 

• a choice-set function Y : x S — > p(A) where F(u, s) is the set of 
actions for ui to choose from in state s. 



A situation for the Dalmas D is determined by the agent to move, w, 
and the state s. A situation is represented by an ordered pair (u),s). The 
set of situations for D is thus Q x S. 

In a Dalmas, all the agents have the same initial set of actions. The set 
of actions to choose from (the choice-set) in a situation (u, s) is determined 
by the agent's deontic structure A(u, s) and preference structure n(a>, s). 
If T(uj, s) consists of one action, then this action applied in the situation 
{uj, s) is the resulting state when u> acts in state s. 

A simple Dalmas is a Dalmas containing the following simple versions 
of A, n, and V. 

1. A(oj, s) C A(u>, s) and A(ui, s) is the set of permissible actions for u> 
in the state s, 

2. n(u,s) = (A.(u, s), £;) where ^ is a weak ordering, 9 

3. r(w, s) = {x G A(w, s) : for all y G A(w, s), i ^ y} . 

7 According to Savage I2B1 p. 13: "an act is a function attaching a consequence to each state 
of the world" . 

8 Two structures are of the same type if they have the same number of relations and 
corresponding relations in both structures have the same arity. 

9 {A, ^} is a weak ordering if for all a, b, c in A, the following axioms are satisfied: a b or 
b y a; if a ^ b and b £3 c, then a £3 c. 
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Hence, in a simple Dalmas the choice-set consists of the best actions 
which are permissible. Among the elements in A there can be a pass 
action, which means the agent does nothing. If we combine the existence 
of such an action with very short clock cycles, we obtain systems with 
close to asynchronous behaviour (cf. |S] |1U|1. 

A Dalmas is not deterministic, since it does not determine in which 
order the agents are going to move, and the choice-set may contain more 
than one action in every situation. Let us therefore make the following 
definition. 

Definition. A deterministic Dalmas is an ordered 9-tuple 

{SI, A, S, A, A, II, T, r, 7> such that {SI, A, S, A, A, II, T) is a Dalmas 

and 

• r : SI — ► SI is a turn-operator such that t(uj) = x means that it is 
x's turn after ui; t determines a simple agent priority, 

• 7 : p{A) — > A is a tie-breaking function, determining which of 
several permissible and equally preferred actions to choose. 

■ 

Note that j(T(u,s)) G A and thus [j(F(u,8))] (w,s) £ S. Define / : 
SI x S — ► SI x S in the following way: 

f(u,s) = (t(cj), [y(T(u), s))] (u,s)). Note further that it is possible to 
iterate /. We define f n as: 
f 1 (u,a) = f(u,a) 
/»( W)S ) = /(/C"- 1 )( W)S )). 

Definition. The fc-event run of a deterministic Dalmas 33 determined by 
the initial situation (ujo ,so) is the sequence ( (u>o ,so) , f 1 (wo , so ),••■, / (wo , so ) ) ■ 
■ 

Suppose that {SI, A, S, A, A, II, T, r, 7} is a deterministic Dalmas. Then 
{SI x S, T, (j>) is a dynamical system, where T is the set of natural numbers 
and 4> is the evolution operator defined by (j> : SI x S x T — > SI x S such 
that 

<Mw,s,0) = {uj,s) 

<t>{u,s,t) = f{u,s) if t > l. 10 

Note that {4>{u>o, so, 0), 4>{loo, so, 1), <j>{u>o, so, k)) is the run of S deter- 
mined by {ojo, so) and consisting of k moves. 

3.2 The Waste Collector System as a Dalmas 

We elucidate some of the aspects of the definition of a Dalmas using the 
waste collectors example introduced in section 2.1. 

3.2.1 Agents and States 

Suppose that we have a set SI of k agents, SI — {ui, uik} ■ A state for the 
system is characterized by the position of each of the agents, the location 

See, for example, [1J p. 8 for a definition of dynamical system. 
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of the waste, and the amount of waste each agent has collected. A state 
s is therefore characterized by three functions, 

7r : SI — >N such that 7r(a>i) 7^ iv(u)2) if wi 7^ co2- 

7 : N 2 — ► Re. 

a : SI — > Re. 

7r assigns a position to each of the agents, 7 assigns the amount of 
waste to each position, and a assigns the amount of waste each agent 
has collected. To denote points in N 2 , bold face letters x,y,... will be 
used. If x = (xi,X2) G N 2 then x' 1 - 1 = xi and x' 2 - 1 = xi- If the state s 
is represented by the ordered triple of 7r,7 and a, i.e. s = {n, 7, a) , then 
s' 1 - 1 = 7r, s' 2 ^ = 7, and = a. Let S be the state space of the system. 
A state s can be an initial state if s' 3 '^) = 0, for all cj € SI. 

3.2.2 Actions and Utility 

Each agent has a repertoire of four different actions, viz. going east, going 
south, going west, and going north. For simplicity, we denote the actions 
with their point of compass: east, south, west, and north. Now, east is 
defined as: east(ui,s) = (tv,j,o) where 

1. 7r(w) = <(s (1) (o;)) (1) + 1, (s (2) H) (2) ) and tt(x) = s w {x), if x ^ w, 

2. 7(x,y) = if 7r(w) = and 7(0;, y) = s (2) (£,y), if tt(w) / (x,y> , 

3. = s^{uj) +s^(tv{lj)). 

The other actions are defined analogously. The 'feasibility function' A is 
such that an action is feasible as long as the performing of the action leads 
to a new state within the boundaries of the grid. 

The preference structure is determined by a utility function 

U w : S — > Re for every agent u>: H(lo,s) — {A(u>, s), £ w ,s), such that 
a>z u , s biSU u {a(uj,s))>U u {b(uj,8)). 

The utility function for an agent can be defined in many ways and we 
will leave open the exact definition of it. The norm-regulated Dalmas 
can have its choice-set function T defined as: 

r(w, s) = {x G A(w, s) : for all y G A(w, s), x >; w , s y} . 

4 Conditions and Normative Systems for 
a Dalmas 

4.1 Preamble 

In this section, the building blocks of norms which can regulate a Dalmas 
will be described. The grounds and consequences consist of conditions on 
agents, true or false in a situation. This kind of conditions are called 
sit-conditions. As its core, a sit-condition has a state-condition, i.e. a 
condition true or false in a state. We obtain sit-conditions from state- 
conditions by the application of the operators M,T\, ...,T-j. Suppose c is 
a !/-ary state-condition. Then c{u>i, ...,u>k) is true or false in a state s and 
Mc and Tic arc i^+l-ary sit-conditions. Mc(u>i, ...,u) v ,u) v +i) is defined 
as being true in situation {co,s) if and only if c{u>\ , u>k) is true in s 
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and it is w^+i's turn to draw, i.e. u> v +i = w. Tic(u)i, lo v , is 
true in (cu, s) if and only if Tj is the normative position for uv+i with 
respect to c(wi, ...,cu v ) being true in the state that will be the result of 
the action taken in (lo,s), where T; is the ith type of the one agent 
positions. Elementary norms for a Dalmas are ordered pairs of the form 
{Mc, Tid) where c and d are state-conditions, Mc is the ground, and Tid 
the consequence. In this essay, we will focus on elementary norms. 

The rest of this section is devoted to a detailed development of the 
ideas just presented. 

4.2 State-Conditions and Sit-Conditions 

The idea behind the definition of a Dalmas is that its behaviour will be 
regulated by a normative system and that the normative system will be 
represented by a ground-consequence system (B\, B2, J) where B\ and B2 
are condition implication structures. The condition of interests in connec- 
tion with a Dalmas is a little more complicated than those discussed in 
section 2 and it is pertinent to distinguish between two different kinds of 
conditions, viz. 

1. condition on agents in a state, abbreviated just 'state-condition' 

2. condition on agents in a situation, abbreviated just 'sit-condition'. 

A v— ary state-condition c is true or false of v agents ui,...,w„ in a 
state s, which will be written c(u>i, u) v ; s). Note the use of the semi- 
colon to separate the state from the agents. A v— ary sit-condition d is 
true or false of v agents u>i, uj v in a state (w, s), which will be written 
d(u>i, w„; ui, s). 

A normative system regulating a Dalmas is a ground-consequence 
system {Bi , B2 , J) where B\ and B2 are condition implication structures 
consisting of certain kinds of sit-conditions. These sit-conditions are the 
result of applying certain operations to state-conditions. We discuss this 
in next subsection. 

4.3 The Move-Operator 

Let us now introduce the move-operator M which transforms a v— ary 
state-condition to a v— ary sit-condition. 

Definition. M is an operator on state-conditions such that if c is a v— ary 
state-condition then Mc is a v— ary sit-condition and 
Mc(wi, lj„, w„+i; w, s) iff lo v +i = w and c(o>i, co v ; s). m 

Note that Mc(o»i, ui v ,ui v +i; ui, s) means that u> v +i is to move in 
state (u), s) (since u) u +i = iv), and c(o>i, lo v \ s). 

If (B , A,' , R) is a Boolean quasi-ordering where B consists of state- 
conditions. Define Bm = {Mb : b £ B} . We can now define a unary 
operation ' M on Bm in the following way: (Mc)' M — M(c'). 

Note that (Mc)' M (u>i, oj v , w„+i;w, s) iff M{c'){uj\, lj v , w„+i; w, s) 
iff w^+i = oj and c'(cji, uj v ; s). Define a binary relation Am on Bm in 
the following way: Mb Am Mc = M(b A c). 
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Note that (Mb Am Mc)(wi, u) u , kv+ii s) iff 
M(b A c)(wi, w, s) iff 
[w„+i = w and (6 A c)(wi, o;„; s)] iff 
\lj v+ i — lu and b(uii, oj„; s) and c(o;i, ...,u> v ; s)] iff 
[(M6)(ii)i,...,Ui„iiVn;iii,») and (Mc)(wi,...,w B ,w„ + i;w,s)]. 
Let us further define a binary relation Bm on B in the following way: 
bRc. It is easy to see that M is an isomorphism from (B, A,' ,R) to 
(Bm, Am,'m iRm) which thus also is a Boolean quasiordering. We say 
that {Bm,Am,' m ,Rm} is the m-cis over {B, A,' , R). 

4.4 The Type-Operators 

Type-operators (see 1210 can be applied to state-conditions, resulting in 
sit-conditions. 

Definition. For i, 1 < i < 7, T is an operator on state-conditions such 
that if c is a v— ary state-condition then Tic is a v— ary sit-condition and 
Tic(uJi, w v ,u) v +i;u), s) iff T<(w„+i, c(wi, kv; s + )) where Ti is the ith 
type of the one agent positions and s + is the state which will be the result 
of the action taken by u> in state s. m 

The meaning of Ti is discussed in more detail in section 5. 

Suppose that (B, A,' , R) is a Boolean quasi-ordering where B consists 
of state-conditions, define Bt = {Tib : b £ B and 1 < i < 7}. Bt is the 
set of normative positions over B. If Tib,TjC £ Bt, then define 

(1) (Tib At Tjc)(uji, w B! u«+i;w, s) iff Tb(uji, w„,w„ + i;w,s) and 
Tjc(uji, ...,lj„,U} u +i;u,s), 

(2) (T»&)T(a;i, w„, w„+x;u, s) iff -iTj6(wi, — , w„, w^+i; w, s). 

Define recursively as follows: 

(1) B T C 

(2) If p, g g By then G By and p At q G B T 

(3) The only members of B T are those resulting from a finite number 
of applications of (1) and (2). 

Definition. A normative-position-cis (np-cis) over a cis (B, A,' ,R) is a 
Boolean quasi-ordering (B T , At ,'t i -Rt) with Tt as unit element, J_t as 
zero element and where Qt is the indifference part of Rt such that the 
following requirements are satisfied. For any c, d £ B it holds that: 

(1) if i± j, then (Tid At Tj<t)R T ±T (for i,j G {1,...,7}), 

(2) T t Rt (Tid V T ... V T Trd), 

(3) TidQ T Ti(d'), T 3 dQ T T 3 (d'), T 6 dQ T T 6 (d'), T2dQ T T i (d l ), T 5 dQ T T 7 (d') 

(4) if c = d then TicQrTd (for i, j G {1, 7}), 

(5) T(T)Q t ±t if i = 1,3,4,7, 

(6) T l (±)Q T ±T if i = 1,2,3,5. ■ 

The reason for (3) is a kind of 'symmetry principle '(see section 2.3), 
and the justification for (4) is a logical postulate. The notion of an np-cis 
was introduced in I21| . 
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4.5 A Norm-Regulated Dalmas 

Definition. A normative system J\f for a Dalmas 23 is a gc-system 
(Cm,T>t, J) such that Cm=(C'm, Am,m , -Rm) is the m-cis over (C, A,' , Rc) 
and Dt = (-D T , At,t j -Rt) is an np-cis over (D, A,' , Rd) where C and D 
are sets of state-conditions for 33. ■ 

In the sequel, we will omit the M and T subscripts in Am and ' M , and 
in At and ' T . 

If (Cm,T>t,J) is a normative system, then it is joining Cm and 2>r- 
If (x, y) £ J then (a, y) is a norm in Af and a; is i/ie ground and y is 
t/ie consequence of that norm. Note that a norm in J\f is a correlation of 
normative consequences to descriptive conditions. If {x, y) is a norm in AT 
and t/ G Dt then (a;, y) is an elementary norm. An elementary norm in 
Af is an ordered pair (Mc, Tid) where c £ C and d £ D and the intended 
interpretation of it is a sentence of the following form: 

Vwi, ...,lu v ,lu 6 S] : Vs 6 S : Mc(wi, av, a>; a>, s) — > Ttd(uJi, av, w; a>, s + ) 
or somewhat more generally: 

Vwi, ...,lu v ,lu G : Vs G 5 : Mc(loi, w, s) — ► Tid(uJi, lu„, w; w, s + ) 

where y = max{/x, i'} and s + is the state which will be the result of the 
action taken by w in state s. In both cases the norm above is represented 
as the ordered pair (Mc, Tid) . 

Definition. A norm-regulated Dalmas is a system [23, M] where 23 is a 
Dalmas and Af is a normative system for 23 . ■ 

The idea behind a norm-regulated Dalmas is that the deontic struc- 
ture operator A is defined in terms of M in the sense that what is per- 
missible to do in a situation is determined by the normative system. We 
will return to this in section 5. 

4.6 Norms for the Waste Collectors 

Essential to the behaviour of the collectors is how close they are to each 
other. To be able to talk about the nearness of the collectors it is conve- 
nient to infer the notion of an n-surrounding. 

Definition. The n— surrounding of the point (x,y) G N 2 is the set 
{(z,u) : \x — z\ < n and \y — u\ < n}, and denoted by Surr n (x,y). 
m 

We can now define a family of state-conditions expressing overlapping 
surroundings: 

Definition. Lapj is the state-condition such that Lapj(uii, u)2', s) iff 
Surrj(s^ (u>i)) n Surrj(s < - 1 ^ (tU2)) contains exactly j elements. ■ 

If we apply the move operator and the type operators, we obtain 
sit-conditions from the state-conditions Lapj, i.e. we get MLapj and 
TiLapj We also need the non-identity condition d, defined by d(wi,W2) iff 
u>\ L02, and the sit-condition Md. 



17 



We can use the introduced terminology to express the norms for the 
waste collectors presented in subsection 2.1. The result is the following set 
of ordered pairs of sit-conditions. For legibility reasons, we use — instead 
of / for negation. 

1. {MLap ,T 4 Lap 2 V T 6 Lap 2 V T 7 Lap 2 ) 

2. (MLap ,T 4 Lap 3 V T 6 Lap 3 V T 7 Lap 3 ) 

3. {MLapo, TiLapo V T 2 Lap V T 3 Lap {) V T 5 Lap ) 

4. (MLapo, TiLapi V T 2 Lapi V T 3 £api V T 5 La Pl ) 

5. For all i, < j < 9, (MLap 1 ,T 1 Lap j V T 2 Lajj j V TsLapj V T B Lapj) 

6. For alH, < j < 9, (MLap 2 , TxLapj V T 2 iap i V TsLapj V T B Lapj) 

7. (M(—Lap 4 A —Lape A —LapQ),TyLape) 

8. {MLap 4 ,T 7 Lap 3 ) 

9. (MLape, T 5 (Lap4 V Lap6 V Lapc,)} 

10. (Md,T 7 Lap g ) 

11. (MT, TiLapo V T 2 Lap V T 3 Lop V T 5 Lap ) 

The correspondence between the norms (rii) — (ns) in section 2 and 
the norms above is the following: 



(m) 


is 


represented 


as 


(1) and (2), 


(n 2 ) 


is 


represented 


as 


(3) and (4), 


(n 3 ) 


is 


represented 


as 


(5) and (6), 




is 


represented 


as 


(7), 


( n 5) 


is 


represented 


as 


(8), 


(ri6) 


is 


represented 


as 


(9), 


(n 7 ) 


is 


represented 


as 


(10), 


(ns) 


is 


represented 


as 


(11). 



Note that the among the norms (l)-(ll), only (7)-(10) are elementary. 

5 From Norms to Actions 

In this section, a scheme for how normative positions will restrict the set 
of acts that the agents are permitted to choose from is presented. The 
idea behind a norm-regulated Dalmas is that the deontic structure oper- 
ator A is defined in terms of M in the sense that what is permissible to 
do in a situation is determined by the normative system. More formally, 
let us suppose that the system is in situation (lo, s) and that (Mc, Tid) is 
a norm in J\f ■ Suppose further that c and d are v— ary and c(a>i, uj v ; s). 
Hence, Mc(wi, u) v , ui; u>, s). From Mc(ui,...,w„,w;w,s) together with 
the norm (Mc,Tid) follows that Tid^i, a>„, ui; ui, s). An important 
question now is what restrictions on the set of feasible acts follow from 
Tjd(a>i, u> v ,u>]u,s), i.e. what is prohibited by Tjd(wi, w„, w; o», s)? 
Let us see what holds when i — 2. The intended interpretation of T 2 is 
given by 
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T2d(uji, uj v ,uj\ lo, s) iff T2(w, d(u>i, u>„; s + )) iff 
MayDo(oj, d(u>i, ...,u) v ; s + )) & MayPass(o>, d(u>i, s + )) & 
^MayDo(u;, ui v ; s + )). 

Only the third conjunction above results in a prohibition: in the sit- 
uation (u),s) , u) may not see to it that not d(u>i, ...,lo v ) will be the case 
in the next state. What does this mean? If in state s d(u>i, ...,u„) is true 
but in state s + , which is the result of lo's performing action a in situation 
s, d(uJi, ...,lo u ) is not true, then lo has seen to it that not d(coi, ...,lo u ), by 
doing a. Since lo may not see to it that d(wi, lo v ), it follows that a is 
prohibited. 

Let us now consider the case i = 3. According to the intended inter- 
pretation of T36? it holds that 

T 3 d(u;i, ...,u„,w;u,s) iff 
MayDo(w, d(u)i, ...,lo v ; s + )) & -1 MayPass(ai, d{u\, lo v ; s + )) & 
MayDo(cj, -id(u>i, s + )). 

If c?(wi, w„) is true in s and d(aii, uv) is true in s + , then Pass(w, d(uo\, w„; s H 
If is true in s and -id(u;i, ov) is true in s + then Pass(a;, d(u)i, ...,av 

Therefore, 

Pass(aj, w„; s)) iff [d(wi, w^) is true in s iff io v ) is true in s 

Hence, if lo may not be passive with regard to d(coi, lo v ) in {lo, s), then 
[d(u>i, ...,lo v ;s) iff ui v ; a(u, s))] implies that a is prohibited. 

The other type-operators Tj can be analyzed in an analogous way. As 
the result of such an analysis, we suggest the following stipulations. 11 

1. From Tid(uii, ...,lo v ,lo;ui, s) follows no restriction on the acts. 

2. From T2tZ(a»i, lo v ,lo; lo, s) follows that 

if d(u>i, lo v ; s) and -id(o>i, lo v ; a{uj, s)) then Prohibited„ iS (a). 

3. From Tzd{w\, ...,lo v lo; lo, s) follows that 

if [d(iOi, ...,lo v ; s) iff d(o»i, av; a{io, s))] then Prohibited^ (a). 

4. From T4d(u>i, ...,lo u ,lo; lo, s) follows that 

if lo v ; s) and d(u>i, ...,w„; a(w, s)) then Prohibited^ (a). 

5. From Tscf(u;i, ...,lo u ,lo; lo, s) follows that 

if -^d(toi, ...,Lo v ;a(uj,s)) then Prohibited^ (a). 

6. From T@d(uJi, ...,lo u ,lo; lo, s) follows that 

if not [d(u!i, lo v ; s) iff d(uii, av; a(u), s)] then Prohibited„ jS (a). 

7. From Tyd(uJi, lo v ,lo;lo,s) follows that 

if d(u>i, ...,lo v ;cl(lo,s)) then Prohibited tJi3 (a). 

These stipulations can now be used to define the deontic structure- 
operator A. One possibility is to let A(lo,s) be the set of feasible acts 
a that are not eliminated as Prohibited^ (a) according to the rules 1- 
7 above, where Prohibited^ (a) is equivalent to -iPermissible tl , iS (a). 12 
Hence, A(w, s) = {Permissible^ (a) : a G ^4}. 

11 Note that this explication of T\ — T7 can easily be transformed to an explication of the 
one agent types T1-T7 within the framework of predicate logic. 

12 The mentioned connection between Prohibited and Permissible is naturally not the only 
possible. 
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Note that in the outset all feasible acts are permissible, i.e. for all 
a £ A, Permissible^ (a). The basic idea is now that we eliminate elements 
from the set of permissible acts for lo in s using the norms and sentences 
expressing what holds for the agents with respect to grounds in the norms. 
To facilitate the presentation it is convenient to introduce the following 
six operators on state-conditions: 

E2<i{uJi, w, s) iff [d(ui, w„; s) and w„; a(w,s))] 

E$d(u)i, lo v ,lo; w, s) iff [d(wi, u„\ s) iff d(wi, w„; a(w, s))] 
E%d(uJi, lo v ,lo; lo, s) iff [-id(wi, ...,w„; s) and d(wi, a(w, s))] 
Egd(coi, ...,w„,w;w, s) iff [-id(wi, w„; o(w, s))] 
E%d(uJi, lo v ,lo; lo, s) iff not [d(a»i, lo v ; s) iff d(wi, w„; a(cu, s))] 
E°d(wi,..., w„, w; iff d(wi, w„; a(w, s)). 

Note that for all i, 2 < i < 7, (T;d A E?d)(coi, ...,u) v , lo; lo, s) implies that 
Prohibited„ iS (a). 

In situation (w, s), the action a is prohibited if there are c G C and 
d <= D such that (Mc, T,d) is a norm for some i, 2 < i < 7, and there are 
loi,lo'2, ...lo v G f2 such that Mc(wi, a>„, o»; w, s) and Efd(u>i, ...,lo v ,lo;lo,s). 
The essential part of the procedure is the following inference: 

Mc(wi, ...,w„,w;w,s) & (Mc,T x d) 

TidjLO!, ...,uj v ,uj;uo,s) Ejd(mi, ...,lo„,lo;lo,s) 

Prohibited^ :S (a) 

Now we can for the normative system M= {Cm, T>t, ^7} define Prohibited^ iS 
more explicitly as: 

Prohibited^, s = {a G „4(a;, s) | 3c G C : 3d G D : 3i, 2 < i < 7 : 

(Mc,Tid) £ J & 3wi, G n : Mc(wi,...,w^,«;w,s) & 
Eid{u\, ...,«„,w;w,s)}. 

Thus, A(w,s) can be defined as A(a>,s) = -A(a>, s)\Prohibitedo;,s, i.e. 
A(a>, s) = {a G -A(w, s) | a ^ Prohibited^}. 

For a simple Dalmas it is a small step from A(lo,s) to r(u),s). If 
D is a simple Dalmas, then V(lo,s) = LT(a>, s)/A(o>, s), i.e. F(lo,s) = 
(A(w, s), where is the restriction of £3 to A(u»,s). 

In the definition of Prohibited^ above, we use only norms that are el- 
ementary. Whether this implies substantial limitations will here be left as 
an open problem. Consider for example the norm (Mc,t) where t G D?- 
The problem is under what state condition e the consequence t implies a 
prohibition of an act. We do not deal with this problem, but just point 
out that 

(Tjjdi V T i2 d 2 )(Lo 1 , ...,lo v ,lo;lo,s) — > 

[(£?di AE? 2 d 2 ){ui,...,u v ,u;w,s) — > Prohibited^ (a)]. 
(Tjjdi A T i2 d 2 )(LOi, ...,lo v ,lo;lo,s) — > 

[(E^di V£?(i2)(wi,...,^,w;a),s) — > Prohibited^ (a)] . 

Another way of dealing with {Mc, t) is to try and show that all pro- 
hibitions following from it also follow from elementary (and eventually 
minimal) norms. 
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6 Conclusion and Discussion 



The aim of this study is to present a theory of how norms can be used 
to regulate the behaviour of multi-agent systems on the assumption that 
the role of norms is to define the Spielraum for an agent. The theory can 
be summarized as follows. The norms for a Mas are regarded as belong- 
ing to a normative system and such a system is represented algebraically 
as a ground-consequence system containing a Boolean quasi-ordering of 
grounds and a Boolean quasi-ordering of consequences. The norms are 
joinings from grounds to consequences, and the specific normative con- 
tent of a normative system is given by the set of minimal norms. The 
consequences are expressed using operators on conditions corresponding 
to the Kanger-Lindahl types of one-agent positions. An important step 
in the theory construction is the specification under what circumstances 
the sentence Tid{u>i, ...,uj u ,lo\lu,s) implies that an action a is prohibited 
for the agent lo in the state s (see section 5). An action a is regarded as 
a function, which is the usual way of representing an action in decision 
theory, and d is a i^-ary condition on agents, true or false in the situa- 
tion s. An abstract architecture based on the theory of norm-regulation 
of behaviour is defined, and a Mas having this architecture is called a 
norm-regulated Dalmas. The system of waste collectors is an example of 
a such a norm-regulated Dalmas. 

An important tool in the present study is the characterization of ab- 
stract architectures by the definitions of set-theoretical predicates. Among 
the abstract architectures defined in this way, the most important one is 
a norm-regulated Dalmas, as exemplified in the previous section. This is 
just the first step towards a theory of architectures for Mas that restricts 
the behaviour of the system using norms. The theory can be developed by 
defining a number of set-theoretical predicates that are specifications of 
the predicate Dalmas, and we can obtain a hierarchy of predicates with 
Dalmas as its root. 13 

There are many refinements and extensions to be made before it is 
possible to state the significance of the theory. For instance, the mini- 
mal norms represent the specific normative content of a normative sys- 
tem. It is therefore a reasonable question, whether, in the definition of 
Prohibited^, it is sufficient to regard only minimal norms. Note that the 
stipulations expressing under what conditions Tid implies that the act a 
is prohibited are independent of the structure over the consequences. The 
latter, however, is relevant to determining the minimal norms. 

Moreover, in the definition of Prohibited^ jS above, we use only norms 
that are elementary. Whether this implies substantial limitations ought 
to be investigated. Consider the norm {Mc, t) where t G DJ- Under what 
state condition e does the consequence t imply a prohibition of an act? Is 
it possible to prove that all prohibitions following from it also follow from 
elementary (and minimal) norms? 

We have only considered norms of a rather special kind. The descrip- 
tive conditions are conditions on agents. Let us call them 'agent norms'. 

13 One set-theoretical predicate is a specification of another *Pi if the following holds: if 
S2 is a *P2 there is a sub-sequence Si of ©2 that is a *Pi . The relation 'to be a specification 
of is a partial order. 
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An example of an elementary agent norm is (Mc, Tid), where c and d 
are conditions on agents, true or false in a state. However, it is easy to 
generalize so that c and d can be conditions not just on agents but on a 
set U containing agents and objects of other kinds, for example physical 
objects. It seems to be straightforward to change our definitions so that 
this alternative will be accommodated. 

Norms of a radically different character than agent norms are norms 
determining which are the agent norms for a Mas. Such norms can for 
example give competence to some agents to functions as a kind of 'legis- 
lators' and change the agent norms [29]. 

In this essay, we have tried to show how theories of normative positions 
and normative systems can be used in constructing an architecture for 
norm-regulated Mas. However, we have only used a small portion of 
the Kanger-Lindahl theory of normative positions, namely the theory of 
one-agent types. According to the intended interpretation of the type 
operators in section 4, 

Tjc(wi, ...,lu„,luv +1 ;lj,s) 

means that lj„+i has the normative positions of type Ti with respect to the 
state of affairs that c(o>i, lo v ; s + ). Here Ti is a one-agent type-operator. 
A two-agent type-operator Wi applied to c will give a condition WiC such 
that 

WiC{0Jl, ...,L0v,LJ„ + 1 ,LUv + 2;UJ, s) 

means that the party uj v +i has the normative positions of type Wi versus 
the counter party u>„+2 with respect to the state of affairs that c{u)\, ...,u v ;u), 
14 The use of two-agent type-operators in norm-regulated Dalmas will 
increase the strength and flexibility of the Dalmas hierarchy of abstract 
architectures. 

In a norm-regulated Dalmas, the normative system plays the role of 
constitutive rules, and it is not possible for the agents to break the norms. 
In spite of this, it is reasonable to distinguish between 'may' and 'can'. 
What an agent uj can do in a situation s is given by A(uj, s) and what it 
may do is determined by A(cu,s). Note also that the formal framework 
for representing norms can be used for different kinds of norms, even 
regulative norms. For example, an agent can choose between obeying a 
regulative law or breaking it and thereby giving one or several other agents 
the right (but possibly not the duty) to punish it, either immediately or 
when it is its turn to move. This can easily be expressed using normative 
positions. 

Dalmas and deterministic Dalmas are intended to function as wide 
frames for studying norm-regulations of Mas and thus to be weak abstract 
architectures. Are they weak enough or are they excluding something 
essential? As has been pointed out earlier, for instance, a Dalmas has 
global states and global dynamics. This fact notwithstanding, the formal 
definition of a Dalmas is flexible enough to incorporate a kind of history 
dependence. One way of doing this is to introduce a set P of primary states 
(phases) such that s € S iff s — {p, (pi, ...,p u )}, where p,pi, ...,Pl, G P. 

See E3, chapter 4. 
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The intended interpretation is that when 33 is in s then 33 is in the primary 
state p and its history is (pi, ...,p„), i.e. the passed primary states of 33 
is given by (pi, ...,p„). Note that if si = (p, o\) and S2 = (p, 02) where 
01 7^ 02, then it is possible that a(o», si) / a(w,S2), so the result of 
a> performing act a in the primary state p is dependent on the passed 
primary states of 33. 

Another way to obtain history dependence is to use the definition of a 
run (see section 3.1). With some modifications a run can be regarded as 
a state consisting of situations based on primary states. In this case we 
have dependence not just on passed primary states but on passed primary 
situations. If the Dalmas in question is deterministic, passed actions 
also determine passed primary situations, but the opposite does not hold. 
Therefore, we can distinguish between dependence on previous primary 
states, dependence on previous primary situations, and dependence on 
previous actions. 

Suppose that 33 is a Dalmas, in which the agents cooperate to solve a 
problem. Which normative system will lead to the most effective behavior 
of the system? It is desirable that 33 itself could determine the optimal 
normative system for the task in question. Given a set of grounds and a set 
of consequences, which together constitute the vocabulary of the system, 
33 can test all possible sets of minimal norms. If there is a function for 
evaluating the result of a run of 33 , then different normative systems can 
be compared and the best system can be chosen. A change of vocabulary 
corresponds to a mutation in the normative system, which can lead to 
dramatic changes of efficiency. Note that, in principle, the evaluation 
function can be very complicated, for example it can be multi-dimensional 
and based on ideas of fairness. This seems to imply that we can treat 
multi-agent systems as consisting of cooperative agents even if they do 
not have what is usually called 'a common interest' and cooperate only 
in the sense that they want to avoid destructive conflicts. 
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